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Abstract 

This paper presents two new iterative algorithms for decoding linear codes based 
on their tail biting trellises, one is unidirectional and the other is bidirectional. Both 
algorithms are computationally efficient and achieves virtually optimum error perfor- 
mance with a small number of decoding iterations. They outperform all the previous 
suboptimal decoding algorithms. The bidirectional algorithm also reduces decoding 
delay. Also presented in the paper is a method for constructing tail biting trellises for 
linear block codes. 
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1 Introduction 


There are two types of trellis representation of codes, conventional trellis representation and 
tail biting trellis representation. In conventional trellis representation of a code [1*3], the 
code trellis has one starting state and one ending state, and the starting state and the ending 
state are the same state. The paths connecting the starting state and the ending state give 
all the codewords (or code sequences) of the code. In tail biting trellis representation of 
a code, the code trellis has multiple starting states and multiple ending states [4-6]. Each 
starting state has a unique corresponding ending state, and they are the same state. A path 
in a tail biting trellis is a valid codeword if and only if it starts from a state and ends at the 
same state. Such a path is called a tail biting path. 

Tail biting trellis representation was first proposed by Solomon and van Tilborg [4] in 
1979 for terminating the code trellis of a convolutional code without code rate loss. This tail 
biting trellis representation of a convolutional code was later generalized by Ma and Wolf [5] 
in 1986. Tail biting of a convolutional code results in a block code. Figure 1 depicts an 8- 
section tail biting trellis with 4 starting states and 4 ending states for a rate- 1/2 convolutional 
code of memory order 2 with generator sequences gi = (1,0, 1) and g 2 = (1, 1, 1) [1]. This 
tail biting convolutional code is a (16,8) linear block code. In [4], a link between quasi-cyclic 
codes and tail biting convolutional codes was also established. This link led to the most 
recent generalization of tail biting trellis representations of linear block codes by Calderbank, 
Forney and Vardy [6]. 

Tail biting trellis representation of a linear block code can significantly reduce the overall 
state and branch complexities of its conventional trellis representation, especially for long 
codes. Figures 2 and 3 depict a minimal 8-section conventional trellis and a minimal 8-section 
tail biting trellis for the (8,4,4) Reed-Muller (RM) code, respectively. The conventional 
trellis for this code has a total of 34 states and a total of 44 branches. The maximum state 
complexity (maximum number of states) is 8 which occurs at section boundary locations 3 
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and 5. The tail biting trellis for this code has two starting states, two ending states, a total 
of 30 states and a total of 40 branches. The maximum state complexity is 4. For this short 
code, the reduction in trellis state and branch complexities is small. Consider the (24,12,8) 
Golay code. This code has a minimal 12-section conventional trellis with a total number of 
1,066 states and a total number of 1,960 2-bit branches. The maximum state complexity 
is 256 [7, 8]. However, this code has a 12-section regular tail biting trellis with 16 starting 
states and 16 ending states [6]. The number of states at each section boundary location is 
16. Figure 6 shows the first 4 sections of the tail biting trellis for the code. It has a total 
of 208 states and a total of 384 2-bit branches. The maximum state complexity is 16. We 
see that tail biting trellis representation of the (24,12,8) Golay code results in a significant 
reduction in both state and branch complexities compared with the conventional trellis 
representation. The reduction in state and branch complexities of a code trellis results in 
a reduction of decoding complexity of a trellis-based decoding algorithm. General structure 
and construction of tail biting trellises for linear block codes have been further investigated 

lately [9-12]. 

As pointed out earlier, a path in a tail biting trellis is a valid codeword if and only if its 
starting and ending states are the same. Since there are multiple starting states, a trans- 
mitted codeword can start from any of its starting states which is unknown to the receiver. 
Therefore, any tail biting trellis-based decoding algorithm must have a mechanism to esti- 
mate the starring state for each transmission of a codeword. A simple minded maximum 

T 

likelihood decoding (MLD) algorithm is to treat a tail biting trellis with M starting states 
and M ending states as a union of A / subtrellises, each subtrellis consists of the paths that 
connect a starting state and its corresponding ending state [4]. Each subtrellis is then a 
conventional trellis. Process each subtrellis with the conventional Viterbi algorithm and de- 
termine its survivor. This results in M survivors, one for each subtrellis. Then compare these 
M survivors. The one with the best metric (the largest correlation metric or the smallest 
Euclidean distance metric) is then the most likely (ML) codeword and the decoded codeword. 
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This simple minded MLD algorithm requires to process M subtrellises independently and 
then compares M survivors to make a decoding decision. If M is large, the computational 
complexity can be very large. If a single decoder is used, it also results in long decoding 
delay. If M decoders are used to process the M subtrellises in parallel, this reduces the 
decoding delay but increases the hardware complexity. To reduce the decoding complexity, 
several suboptimal iterative Viterbi-type algorithms for decoding codes based on their tail 

biting trellises have been proposed [5,13-18]. 

In this paper, two new iterative algorithms for decoding codes based on their tail biting 
trellises are presented, one is an unidirectional wrap-around algorithm and the other is a 
bidirectional wrap-around algorithm. In these algorithms, both cumulative state metric and 
path metric are used to determine surviving paths and the final survivor. During the decod- 
ing iteration process, the decoder continues updating the best surviving path until certain 
termination condition is met. Both algorithms are computationally efficient and achieves 
virtually optimum error performance with a small number of iterations, say 2 to 4, for al- 
most the entire range of signal-to-noise ratios (SNR) for many codes being simulated. They 
outperform all the previous suboptimal decoding algorithms. The bidirectional algorithm 
also reduces decoding delay. Also presented in this paper is a simple method for constructing 
tail biting trellises for linear block codes. 

2 Preliminary and Review 

This section first provides some needed background information regarding tail biting trellises 
for linear codes and then gives a brief review of existing algorithms for decoding codes based 
on their tail biting trellises. 

Let T be an X-section tail biting trellis for a binary linear code C with section boundary 
locations indexed by 0, 1, 2, ■ ■ • , X. These boundary locations also serve as time indices [2, 3, 
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7, 8]. For 0 < t < L, let 


T<(C) ^ t,qi } ( 1) 

denote the state space of the tail biting trellis T at boundary location-t (or time-t), where 
q t = |E t (C)|. Then E 0 (C) and Er,(C) are the starting and ending (or final) state spaces of 
T, respectively, and 

Eo(C) = S t (C), (2) 

i.e., E 0 (C) and E l(C) consists of the same set of states. Hence, q 0 = qL ■ For 1 < i < qo 
(or q^, 5 0 ,i and SL,i are the same state. A tail biting trellis for a convolutional code is 
time-invariant and the state spaces at all the boundary locations are the same, i.e., 

E 0 (C) = E 1 (C) = --- = E l (C). (3) 

Figure 1 displays the time-invariant property of a tail biting trellis for a 4-state convolutional 
code. However, a tail biting trellis for a linear block code is in general time-varying, i.e., for 
0 < i, j < L and i / j, Ej(C) and Ej(C') may not be the same. For example, the minimal 
8-section tail biting trellis for the (8,4,4) RM code shown in Figure 3 is a time-varying tail 
biting trellis. 

The tail biting trellis T may be viewed a s a union of qo subtrellises [4, 12]. Each subtrellis 
consists of those tail biting paths in T that connect a state so,, - boundary location-0 to the 
same state sl,, at boundary location-I, i.e., the starting and ending states of each subtrellis 
are the same. For example, the tail biting trellis shown in Figure 1 consists of 4 subtrellises, 
and the tail biting trellis for the (8,4,4) RM code shown in Figure 3 consists of two subtrellises. 
The tail biting paths of the subtrellis T 0 of T which contains the all-zero path actually form 
a linear subcode C 0 of C [2, 11, 12]. As a result, the other subtrellises of T are the trellises 
for the cosets of C 0 in C. Therefore, the q 0 subtrellises of T are structurally identical (or 
isomorphic). All these subtrellises share a common part from certain boundary location- 
ti to certain boundary location-^ with ti < t 2 [2, 12]. For example, the 4 subtrellises of 
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the tail biting trellis shown in Figure 1 share a common part from boundary location-2 to 
boundary location-6, i.e., they share 4 common trellis sections. The two subtrellises of the 
tail biting trellis for the (8,4,4) RM code shown in Figure 3 share 4 common trellis sections 
from boundary location-2 to boundary location-6. 

Representing a linear code C by a tail biting trellis T with qo starting states and qi 
ending states with qo = qL, a transmitted codeword may start from any of the q 0 starting 
states. If a tail biting trellis based algorithm is used for decoding C, the decoding algorithm 
must first estimate the starting and ending states of the transmitted codeword and then 
determines the most likely codeword that connects the estimated starting and ending states. 
The simple minded tail biting trellis based MLD described in Section 1 requires to process 
qo subtrellises with the Viterbi algorithm independently. For simplicity, we call this \ iterbi- 
type tail biting trellis based MLD as the VTMLD algorithm. Define the Viterbi processing 
of a trellis of L section as a Viterbi trial (VT) and the processing of one trellis section 
(including all the addition, comparison and selection operations) as a Viterbi update 
(VU) [16]. Then the VTMLD algorithm requires a total of qo VT’s and a total of q 0 L VL s 
to make a decoding decision. For large q 0 and L, the VTMLD algorithm results in a large 
computational complexity. 

To overcome the computational complexity problem of the VTMLD algorithm, several 
Viterbi-type suboptimal decoding algorithms have been proposed [13-18]. All these decod- 
ing algorithm^ are iterative in nature and they process the tail biting trellis T of a code 
with the conventional Viterbi algorithm repeatedly until certain stopping conditions are met 
or a preset maximum number of decoding iterations is reached. The differences between 
these suboptimal decoding algorithms are their starting conditions, termination conditions, 
methods for estimating the starting state, and methods for selecting the decoded codeword 
(or sequences). All these suboptimal decoding algorithms require much less VU’s (or VT’s) 
than the VTMLD algorithm at the expense of some performance degradation. 

The first and the simplest suboptimal algorithm for decoding a code based on its tail 
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biting trellis T is the Bar-David algorithm [5] which estimates the starting state based on a 
probabilistic approach. It consists of the following steps: 

1) Choose an arbitrary starting state from E 0 (C). 

2) Process the tail biting trellis T with the Viterbi algorithm to find all the survivors 
originated from the selected starting state to all the ending states in El(C). 

3) Select the survivor with the best metric among all the survivors as the winning path. 

4) Check if the winning path is a tail biting path. If so, stop the decoding process and 
output the winning path as the decoded codeword. Otherwise, go to the next step. 

5) Use the ending state of the winning path as a new starting state. 

6) Check if this starting state has been used before. If so, go to Step 1), otherwise, go to 
step 2). 

The above process continues until a winning tail biting path is found or the number of 
iterations reaches < 70 - For the later case, the decoder simply outputs the best winning path 
at that time. If the winning path is not a tail biting path, it is not a valid codeword. The 
Bar-David algorithm is indeed very simple but has a significant performance degradation 
compared to the VTMLD algorithm, especially for low to medium SNR’s. Even though, for 
large SNR, the average number of decoding iterations (or VT’s) required is small. However, 
for small SNR, the number of decoding iterations required approaches q 0l which results in a 
large number of computations. 

An improvement of Bar-David algorithm is the two-step algorithm devised by Ma and 
Wolf [5]. The first step of this algorithm is to obtain an ordered list of the q 0 starting states 
using an algebraic method called “continued fractions.” The second step of this algorithm 
is to perform Viterbi trials using each entry in the list as the starting state. At the end 
of each Viterbi trial, check whether the winning path is a tail biting path. If so, stop 
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the decoding process and output the winning path as the decoded codeword; otherwise, 
continue the iteration process with the next state on the list as the starting state. This two- 
step algorithm provides some improvement in performance and decoding complexity over 
the Bar-David algorithm, but it still requires a large number of Viterbi trials for small SNR. 

To further improve the performance of Bar-David and M a- Wolf’s two-step algorithms 
and reduce their decoding complexities, Wang and Bhargava [13] proposed another iterative 
decoding algorithm. This algorithm starts processing the tail biting trellis T with the Viterbi 
algorithm from all the states in £ 0 (C) with the same initial state metrics. Every state in 
E 0 (C) is equally likely regarded as the starting state of the transmitted codeword. When 
the processing reaches the end of the tail biting trellis T, tests are performed. Based on the 
results of these tests, the decoder either terminates the decoding process and outputs the 
best tail biting path that has been found or reduces the starting state space by eliminating 
those unlikely starting states and updates the candidate tail biting path (the candidate for 
the decoded codeword) that is stored in a buffer. For the latter case, the decoder processes 
the tail biting trellis T again with the states in the reduced starting state space as the starting 
states with the same state metrics. This iterative process continues until either the most 
likely tail biting path is found or the reduced starting state space is empty. Wang-Bhargava 
algorithm is asymptotically optimal, which improves the error performance of Bar-David 
and Ma-Wolf algorithms with reduced decoding complexity. However, this algorithm is 
quite complex with a number of test conditions and a variable workload. Even though, 
it is asymptotically optimum for high channel SNR, however, it performs relatively poorly 
compared to the VTMLD algorithm for low to medium SNR s. One reason for its poor 
performance for low to medium SNR’s is that the algorithm does not transfer all available 
soft information from trial to trial (or from one iteration to the next iteration). For example, 
at each decoding iteration, all the starting states are assigned the same starting metrics. 
However, the metrics of the states in the reduced starting state space computed at the end 
of the previous Viterbi trial can be used as the starting state metrics for the current trial. 
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This would allow the real starting state to gain momentum faster than the other states in 
the reduced state space. As a result, the iteration decoding process may converge faster. 

To improve the performance of the Wang-Bhargava algorithm, several algorithms were 
devised based on continuous Viterbi processing of a trellis which is a multifold repetition 
(or concatenation) of the tail biting trellis T [14-16]. All the available soft information is 
transferred from one Viterbi trial to the next Viterbi trial. The state metrics at the end of 
one trial are used as the starting state metrics for the next trial. Among these algorithms, the 
most efficient one is the circular Viterbi (CV) algorithm devised by Cox and Sundberg [16]. 
Let T* = T o T o • • • denote the multifold repetition of T where o denotes the concatenation 
operation. The CV algorithm simply processes the extended trellis continuously with the 
Viterbi algorithm. Let * and * 0 be two nonnegative integers such that 0 < * 0 < L and 

* = *o ( modulo L). 

Then 

E«(C) = S« 0 (C). (4) 

At boundary location-* of T*, let denote the metric of state s*.,- (this is simply the 

cumulative metric of the survivor that terminates at state $<,,). The CV algorithm consists 
of the following steps: 

1) Start frdm all the states in E 0 (C) with the same initial state metrics. 

2) Apply the Viterbi algorithm continuously to process T* section by section. At level-* 
(or boundary location-*), record the metric of the surviving path entering each state 
in E t (C) and save the information labeling bits of the surviving branches in a word, 
called the decision word for section-*. 

3) After processing the first L sections of T*, the decoder starts making decoding decision. 
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( 5 ) 


4) For some chosen small t and some constant a, if 

\M(t, i ) — M(t — L, i) — a| < c 

for 1 < i < qt, stop the decoding process and output the winning path between level- 
(t - L ) and level-f (a reordering of the decoded information bits may be needed). 
Otherwise, go to Step 2). 

5) Repeat Steps 2 and 4 until the stopping condition of (5) is met or a maximum number 
of iterations I max is reached. 

With this algorithm, a large storage is required to store all the state metrics over a span 
of L + 1 sections. To simplify this algorithm, the following stopping rule was suggested [16]: 

4*) Check the decision words separated by L sections. If m consecutive decision words are 
the same as their predecessors, the decoding process stops. Otherwise, go to Step 2). 

Simulation results show that the two CV algorithms with stopping conditions 4 and 4*, 
respectively, perform almost equally well in terms of error performance and computational 
complexity. Simulation results also show that the CV algorithm performs better than the 
Wang-Bhargava algorithm for small to medium SNR’s with significant reduction in decoding 
computational complexity. However, for large SNR, the Wang-Bhargava algorithm outper- 
forms the CV algorithm. Both algorithms still have a significant performance degradation 
compared to the VTMLD algorithm. 

The other two continuous Viterbi decoding algorithms [14, 15] based on processing T * 
have similar features as the CV algorithm. 

3 A Wrap-Around Viterbi Algorithm 

This section presents a new iterative algorithm for decoding linear codes based on their tail 
biting trellises. This algorithm is also devised based on processing a tail biting trellis T 
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repeatedly in a continuous manner with the Viterbi algorithm. Each Viterbi processing (or 
Viterbi trial) of T is called an iteration. The algorithm consists of a sequence of decoding 
iterations. The available soft information is transferred from one iteration to the next itera- 
tion. The algorithm starts the decoding process from all the states in Eo(C) with the same 
initial state metrics at the first iteration. At the end of each iteration, if no decoding decision 
is made, the metrics of the ending states in Hl{C) are used as the starting state metrics 
of the next iteration. This is called wrap-around. The wrap-around process results in a 
continuous Viterbi decoding over the tail biting trellis T. The wrap-around processing of 
T continues until certain stopping conditions are met. The algorithm uses cumulative path 
metric during the continuous wrap-around process to select the survivor into each state. 
However, at the end of each iteration, it uses the metric difference between a starting state 
in E 0 (C) and an ending state in E i[C) (if they are connected by a survivor) to determine 
the Z-branch winning path for decoding decision. The decoding process stops if the winning 
path is a tail biting path in T (a codeword in C ) or a maximum number of iterations is 
reached. Decoding decision is made at the end of each iteration. If no decoding decision in 
made at the end of an iteration, a candidate for the final decoded codeword is updated and 
stored. For simplicity, this iterative decoding algorithm is referred to as a wrap-around 
Viterbi (WA-V) algorithm. 

3.1 The^lgorithm 

Assume that the correlation metric is used as the decoding metric. Again let T be an Z- 
section tail biting trellis for a linear code C with starting state space Eo(C'), ending state 
space El(C) and Eo(C) = E l(C). For 0 < t < Z, let E t (C) = ?») denote 

state space of T at section boundary location-*. Since the WA-V algorithm processes T 
repeatedly with the Viterbi algorithm in a continuous manner, the metric of a state in T is 
updated during each iteration. A survivor terminated at a state in T at boundary location-* 
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during the i-th decoding iteration is a surviving path originated from a starting state in 
E 0 (C) at the beginning of the first decoding iteration. For i > 1, 0 < t < L and 1 < k < q t} 
let Cl'l denote the metric of state s t ,k at the i-th decoding iteration which is defined as 
the cumulative path metric of the survivor of the i-th iteration terminated at state s t ,k- At 
the end of the i-th iteration, let pb) denote an T-branch surviving path that connects the 
starting state s 0 ,h in £()(£) and the ending state sij in Er,(C). The path metric of p (,) 
denoted A p (o, is defined as the following difference between the metric C[j of state sij and 
the metric Cq l of state s o,*: 


>(•) 


A /->(>) /->(*') 

- U LJ ~ u 0,h- 


( 6 ) 


The T-branch path with the largest path metric among all the <Jl{ = 9o) surviving Z-branch 
paths in T at the end of the i-th decoding iteration is called the best path, denoted 
Note that the best surviving path is not necessarily a tail biting path in T (or a codeword in 
C). If p[2, { is a tail biting path, decoding stops and the decoder outputs p['^ 3t as the decoded 
codeword. If p^ is not a tail biting path, the decoder finds the best surviving tail biting 
path, denoted pj among all the surviving tail biting paths (if any) at the end of the i-th 
iteration. Use p[^ J( and Pj\ ejt to update the currently stored best path p(, ejt and best tail 
biting path p Tibeat . Whenever p^ e , t = p[£ t , decoding stops. When a maximum number of 
decoding iterations is reached, the decoder outputs pr,6«,( if it exists, otherwise, the decoder 
outputs p& eJ f Let Aj, e3( and Arrest denote the metrics of p<, e4t and pr.tejt) respectively. Then 
the decoder needs to update and store (pi ej( , At eJt ) and (pr.&ejti Arrest) from iteration to 
iteration. 

At the end of the i-th decoding iteration, if no decoding decision is made, the state metric 
vector 


cE>4 






( 7 ) 


is used as the initial state metric vector for the (i + l)-th iteration, i.e., Co +1 ^ = The 
WA-V algorithm can be formulated as follows: 
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1) Initialization - start from all the states in E 0 (C) with the same initial state metric. 

2) For 1 < i < I max , execute the t-th decoding iteration with ^ (C^ is the 

intial state metric vector). At section boundary location-L of T , compare the metrics 
of all the L-branch surviving paths that terminate at the ending states in Ei,(C). Select 
the best path p['^ }t as the winning path of the i-th iteration. If p[^ J{ is a tail biting 
path, go to Step 4). Otherwise, update (pi> e3l , A6 e jt) and go to Step 3). 

3) Find the best surviving tail biting path p^{, ejt (if any). Compare the metrics of Pr\ ejf 
and pr.teit and update (pr.ieji) Ap rtej( ). Check whether i < 7 mar • If so, set i — i + 1 
and go to Step 2). Otherwise, go to Step 5). 

4) Output p[2, ( as the decoded codeword. 

5) Output pr.ieif as the decoded codeword if it exists. Otherwise, output p^, as the 
decoded word. 

Figure 7 depicts the flowchart of the above WA-V algorithm. 

At the beginning of the WA-V decoding, each initial state is treated equally with the same 
starting metric due to our ignorance of the real starting state of the transmitted codeword. 
After several iterations, different initial states may have different state metrics. A path 
stemming from an initial state with larger metric has a better chance to become the winning 
path than the'ones stemming from the initial states with smaller metrics. The larger metric 
an initial state has, the more likely it is the real starting state of the transmitted codeword. 

3.2 Analysis 

Let C 3 denote the set of all paths in T that connect the states in E 0 (C) and the states in 
El(C) (i.e., from any state in S 0 (C) to any state in S£,(C)). Then C 3 is a super code of C. 
The WA-V algorithm is characterized by a number of theorems given below. 
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Theorem 3.1 If all the starting states in S 0 (C) at the beginning of the i-th iteration of the 
WA-V algorithm have the same initial state metrics, then the best L-branch surviving path 
pie»t the end of the i-th iteration has the largest metric among all the codewords in C 3 for 
a given received sequence r. If p[^ Jt is a tail biting path in T , p[g Jt is the most likely codeword 
in C with respect to r. 

Proof: First we note that at the end of the i-th iteration, each survivor terminated at a state 
in El(C) has a larger cumulative path metric than its competitors at any state boundary 
location-* of T for 0 < * < L. If all the states in S 0 (C) have the same initial state metric 
at the beginning of the i-th iteration, it follows from the definition of path metric of an 
£-branch path given by (6) that the best Z-branch surviving path p[ 33t must have the 
largest metric among all the paths in T (or all the codewords in C 3 ) with respect to the 
received sequence r. If p[2>t is a tail biting path, it is a codeword in C and hence the most 
likely codeword in C for the given received sequence r. This proves the theorem. AA. 

Since all the states in £ 0 (C) have the same initial state metrics at the beginning of the 
first iteration, a direct consequence of Theorem 3.1 is Corollary 3.1. 

Corollary 3.1 At the first iteration of the WA-V algorithm, the best L-branch surviving 
path p['| ( is the most likely codeword in C 3 . If p^.\t IS a biting path, it is the most likely 
codeword in C . 

v 

From Corollary 3.1, we see that if decoding is done at the end of the first iteration of 
WA-V algorithm, the decoder output is the most likely codeword in C. 

Theorem 3.2 Fori > 1, if the states in £ 0 (C) do no have the same initial metrics at the 
beginning of the i-th iteration, the best surviving L-branch path p[' e \ t may not be the most 
likely codeword in C 3 and hence it may not be the most likely codeword in C even if it is a 
tail biting path in T. 
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Proof: Recall that the selection of the survivor at a state is based on the cumulative path 
metric up to that state. From (6), we have 

eg = c<:> + v>- < 8 > 

It follows from (8) that for i > 1, a path with a larger path metric A p( ,) can be discarded by 
the WA-V algorithm in favor of a competitor which originates from a state in Eo(C) with a 
larger state metric, if the difference between their path metrics is not enough to compensate 
for the difference between their initial state metrics. In this case, the best surviving L-branch 


path is not the most likely codeword in C, and hence it may not be the most likely 
codeword in C even if it is a tail biting path. AA. 

Theorem 3.2 says that for * > 1, if the decoding is made at the end of the i-th iteration, 
the decoder output may not be the most likely codeword in C. This implies that the W A - \ 
algorithm is not an optimal MLD algorithm. However, simulation results show that this 
algorithm achieves near optimum error performance with only 2 to 4 iterations for many 
codes (block or convolutional). It outperforms all the existing iterative algorithms described 
in Section 2 with smaller computational complexity. 


3.3 Performance and complexity 

The WA-V algorithm has been applied to decode various block and convolutional codes 
based on their tail biting trellises. Simulations results for the AWGN channel show that this 
algorithm achieves near optimum MLD error performance for all the codes being decoded 
with a maximum number I ma x of 2 to 4 iterations. For convolutional codes with L > 6rn 
where m is the memory order, I max = 2 is enough for the WA-V algorithm to achieve 
near optimum error performance. The WA-V algorithm requires much less computational 
complexity than the optimum VTMLD algorithm. Simulation results for several codes are 
given in the following to demonstrate the effectiveness of the WA-V algorithm. 

Figure 8 compares the error performance of the WA-V algorithm with that of the other ex- 
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isting algorithms described in Section 2 for the (64,32) tail biting code obtained by truncating 
the rate-1/2 (2,1,7) convolutional code of memory order m = 7 with generator polynomials 
(712,476)(or generator sequences gi = (1, 1, 1,0,0, 1,0, 1) and g 2 = (1,0,0, 1, 1, 1, 1, 1)) [1]. 
The tail biting trellis for this code has L — 32 sections and 128 states at each section bound- 
ary location. Since for the other existing algorithms, simulations were performed over a 
binary symmetric channel (BSC), we compare the WA-V algorthm with these algorithms 
based on a BSC. From Figure 8, we see that the WA-V algorithm outperforms all the exist- 
ing algorithms. It achieves virtually optimum error performance with a maximum number 
of iterations set to 4 and outperforms the Wang-Bhargava and CV algorithms by 0.2 dB at 
BER’s 10 -3 and 10 — 4 , respectively. It outperforms the Bar-David and Ma-Wolf algorithms 
by 1.0 dB and 0.8 dB at BER=10~ 3 , respectively. Table 1 gives the decoding complexities of 
various algorithms in terms of average number of Viterbi trials required for various SNR’s. 
It shows that the WA-V algorithm requires the least number of Viterbi trials, 1.3 on average. 

The rest of simulation results for the WA-V algorithm given in the following are obtained 
based on an AWGN channel. Figure 9 shows the bit error performance of the WA-V algo- 
rithm for decoding the (128,64) tail biting code obtained by truncating the rate-1/2 (2,1,6) 
convolutional code of memory order m = 6 generated by generator polynomials (554,744) [1]. 
The tail biting trellis of this code has L — 64 sections and 64 states. We see that the WA-V 
algorithm achieves virtually optimum error performance with the maximum number I max 
of iterations set to 2. The average number of iterations required is 1.33 for SNR’s over the 
range 1.0 to 3.0 dB. The figure also shows that the algorithm converges very fast. 

In [6], a 16-state tail biting trellis with 12 sections for the (24,12) Golay code has been 
constructed (see Figure 6). Figures 10 and 11 show the bit and frame error performance of 
the WA-V algorithm for decoding the (24,12) Golay code based on its 16-state tail biting 
trellis. Again, both figures show that the WA-V algorithm achieves virtually optimum error 
performance with the maximum number I max of iterations set to 4. With I max set to 2, 
there is only 0.2 dB performance degradation compared with MLD at BER=10 -4 . Figure 
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12 shows the average number of Viterbi updates versus SNR’s. For I mai - 4, it requires an 
average of 17 Viterbi updates to complete the decoding process at SNR=3 dB. 

A 64-state 12-section tail biting trellis for the (24,12) Golay code can be constructed 
by truncating the 64-state trellis of the rate-1/2 (2,1,6) convolutional code generated by 
generator polynomials (414,730) with L= 12 [17, 18]. Figure 13 shows the bit error perfor- 
mance of the (24,12) Golay code decoded with the WA-V algorithm based on this 64-state 
tail biting trellis. Also included in this figure is the bit error performance of a modified 
CV algorithm devised by Anderson and Hladik [17, 18], called the optimal circular \iterbi 
algorithm (O-CVA) (This algorithm has not been publically reported and the simulation 
results are provided by the authors.) We see that the WA-V algorithm with both I miI = 2 
and 7 maj = 4 outperforms the O-CVA. The O-CVA requires 112 Viterbi updates to complete 
the decoding for each SNR. However, the average numbers of Viterbi updates required by 
the WA-V algorithm with / mar = 4 are 31.67 at 1 dB SNR, 25.65 at 2 dB SNR, 20. 4o at 3 
dB SNR and 16.2 at 4 dB SNR, respectively. For 7 mar = 4, the maximum number of \ iterbi 
updates required is 48. Therefore, the WA-V algorithm outperforms the O-CVA with less 
computational complexity. 

4 An Iterative Bidirectional Viterbi Decoding Algo- 
rithm^ 

All the algorithms, including the WA-V algorithm presented in the last section, for decoding 
linear codes based on their tail biting trellises are unidirectional decoding algorithms which 
process a tail biting trellis in one direction. It is possible to devise a bidirectional decoding 
algorithm which processes a tail biting trellis from both ends simultaneously using two 
decoders. If the bidirectional process is carried out properly, not only optimum or near 
optimum error performance can be achieved but also the decoding delay can be shortened. In 
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this section, such a bidirectional algorithm for decoding linear codes based on their tail biting 
trellises is presented and is called an iterative bidirectional Viterbi (IBD-V) algorithm. 

Consider an (n, k ) code C with an T-section tail biting trellis T. Let v = (t’j , V 2 , • • • , v„) 
be the codeword to be transmitted. Before its transmission, it is permuted into v' = 

Let r = (r 1 ,r n ,r 2 ,r n _i,- ••) be the received sequence. Before decoding, 
r is decomposed into two sequences, r^ = (rj, r 2 , • • • , r n ) and r^ = (r„, r n _j, • • • ,rj). The 
IBD-V algorithm processes the tail biting trellis T simultaneously from both ends (right and 
left) with two Viterbi decoders based on the received sequences and r^ 2 \ respectively. 
The decoders that process the tail biting trellis T from the left and right ends are called the 
left and right Viterbi decoders, respectively. The state space So(C') at boundary location-0 
is the starting state space for the left Viterbi decoder and the state space El{C) at boundary 
location-T is the starting state space for the right Viterbi decoder. The decoding process 
that the two decoders start from opposite ends, work through the trellis and reach to the 
other ends is called a decoding iteration. The IBD-V algorithm consists of a sequence of 
iterations. At the end of each iteration, the two decoders wrap around the tail biting trellis 
T and then continue the decoding process. The metrics of states at each end of T are used 
as the starting state metrics for the next iteration. At the beginning of the first iteration, 
all the starting states in E 0 (C) and S£,(C) have the same initial state metrics. During each 
decoding iteration, the two decoders start to make decoding decision jointly as soon as they 
meet. Iteration process continues until the most likely tail biting path is found or a preset 
maximum number I max of iterations is reached. 

Suppose the two decoders are executing the i-th iteration. For 0 < t < L and 1 < k < q u 
let Cj’l^ and C{j'^ denote the cumulative metrics of the state s t ,k at the boundary location-t 
computed by the left and right Viterbi decoders at the i-th iteration, respectively. There 
are two surviving paths terminating at the state s ti *, one from the left end of the trellis 
T and the other from the right end of T, denoted and \ and are called left and 
right surviving paths, respectively. The T-branch path obtained by concatenating the left 
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surviving path pj'j^ and the right surviving path is called a composite path (CP) 
through s ti k , denoted p* * . A CP that has the same state at both ends is called a composite 
tail biting path (CTP). Let so,h and slj denote the starting states of the left surviving 
path pj’j^ and the right surviving path p[|'\ respectively. Define the metric differences 

Aif = c'f - C‘£\ (9) 

a ;f = c;f-c T L f, (io) 

as the path metric gains of the left and right surviving paths, p ( ( 'j * and p,'[, respectively. 
Then the path metric of the CP through the state st,k is defined as 

a;1° = &‘,f + A’f. do 


As soon as a state s t ,k has been visited by the two Viterbi decoders from opposite direc- 
tions during the i-th iteration, the metric of the CP through this state is computed. The 
CP at boundary location-t that has the largest metric is called the best CP of the i-th 
iteration at the boundary location-f, denoted p^L • Let A^‘ at denote its metric. Let p£ eat 
and A l est denote the best composite path and its metric that have been found and stored 
up to the moment that p‘j aa( i s f° un d- If decoding decision is not made at this moment, 
(pjfit,A*£l t ) is then used to update (pg Mf , Ajj eat ). The pair (pLi. A Lt) are updaded each 
time when each of the two decoders has completed processing one section of the tail biting 
trellis T in opposite directions. If there are CTP’s at the boundary location-f, the CTP that 
has the largest metric is called the best CTP of the i-th iteration at boundary location-f, 
denoted pf^ eat . Let A^ eat denote its metric. Let pf e3t and A£ at denote the best CTP and 
its metric that have been found and stored up to the current moment. If decoding decision 
is not made at this moment, the pair (p?j,ej t) ^t'belt) I s use< I to update (p£ J( ,A^ a( ). The 
pair (p^ at , A^ at ) is updated continuously as the two decoders move in opposite directions 
one section at a time. 

The two decoders process the tail biting trellis T continuously section by section. When 
they reach the opposite ends of T , they wrap around and start the next iteration. The two 
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decoders collaborate to make a decoding decision. A decoding decision is made when the 
best CP found by the two decoders is a tail biting path in T or when a preset maximum 
number of iterations, / mai , is reached. For the latter case, the decoder outputs P(, e ,t (if any), 
otherwise outputs p£ eit (this is not a codeword in C). 

4.1 The algorithm 

During each decoding iteration, the two decoders execute a procedure to find the best CP and 
the best CPT at each boundary location of T to make a decoding decision. The procedure 
to be executed is called the Find-Best(<) procedure. We use flag = 1 to indicate that 
the best CP is found to be a tail biting path, and flag = 0 otherwise. The Find-Best(t) 
procedure at the i-th iteration consists of the following steps: 

a) Compute for all the states s t ,k in E t (C). 

b) Find the best composite path p (> t e jt at location-t. 

c) If Pt£lt is a tail biting path, set flag = 1 and output p‘£ t as the decoded codeword. 
Otherwise, update (pg M( - A U) that are stored in the memor >' a ^d go to step d. 

d) Find the best composite tail biting path, p?j,e] t (if any), update the pair (p lesv&bett) 
that are stored in the memory. 

Set the maximum number of iteration to I max . The IBD-V algorithm consists of the 
following steps: 

A. Set i = 1 .flag = 0, Cq ( 1) = C£ (1) = (-oo, -oo, • • • , -oo) (initial state metrics at both 
ends of T), and A c bejt = Ajf ejt = — oo. 

B. If i < Imax and flag = 0, execute the following steps: 

1) Perform the Viterbi decoding process from both ends of the trellis. 
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2) When the two decoders meet at boundary location-^, set t, = t T = t 0 - 

3) Call and execute the Find-Best(< 0 ) procedure. If flag — 1, stop the decoding 
process. Otherwise, go to Steps 4 and 5. 

4) Set t t = t t + 1. If t t < L, call and execute the Find-Best(*,) procedure. 

5) Set t T = t r + 1. If t T > 0, call and execute the Find-Best(< r ) procedure. 

6) Repeat Steps 4 and 5 simultaneously. If flag is set to 1 by either decoder or by 
both, decoding stops. For the latter case, the two best composite paths found at 
boundary location-*, and -t r are both tail biting paths. If they are not the same, 
the one with larger metric is chosen as the decoded codeword. If flag = 0, update 
(PL.O ALJ and (pLo^L.) and repeat Steps 4 and 5. 

7) When the two decoders reach both ends of the trellis, check if i < /max- If so > 
set i = i + 1 , Co’ ( ° = Ct (i_1) , C£ (<) = Co' (,_1) , go to Step B and start the next 
iteration. Otherwise, go to Step C. 

C. If > — oo, output pj t)t as the decoded codeword; Otherwise output p£ ej£ - 

4.2 Analysis 

Again, let C s be the super code of C which consists of the label sequences of all the paths in 
T as codewords. Assume that transmission is over an AWGN channel. The path in T that 
has the largest correlation metric with the received sequence r is the most likely codeword 
in C, and is called the optimum path, denoted p opt . If p op , is a tail biting path, it is the 
most likely codeword in C. In the following, we prove several theorems which characterize 
the IBD-V algorithm. 

Theorem 4.1 If at the beginning of a decoding iteration of the IBD-V algorithm, all the 
starting states in E 0 (C) for the left decoder have the same initial state metrics and all the 
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starting states in Ej,(C) f or right decoder have the same initial state metrics, the optimum 
path p op t will not be discarded by the decoders during the decoding process. 

Proof: Since all the starting states at each end of T have the same initial state metrics, it 
follows from (6) that the path terminating at a state s t , k at boundary location-t which has 
the largest path metric also has the largest cumulative path metric. A path p in T can be 
discarded by either the left decoder or the right decoder or by both. Suppose the optimum 
path p opt for a given received sequence is discarded at a state s tik at boundary location- 1. 
If it is discarded by the left decoder, the left survivor into state s t<k from the left has larger 
path metric than the part of the optimum path p 0 pt from its starting state in ^o(C) state 
St k . If it is discarded by the right decoder, the the right survivor into state s t , k from the 
right has larger path metric than the part of the optimum path p opf from its starting state 
in Sl(C) to state s tfk . Either case results in a composite path through state s tik that has a 
metric larger than the metric of p opJ . This is not possible since p op( has the largest metric 
with the received sequence. Therefore, p opt will not be discarded by either decoder. AA. 

A direct consequence of Theorem 4.1 is Corollary 4.1. 

Corollary 4.1 If at the beginning of a decoding iteration of the IBD-V algorithm, all the 
starting states in E 0 (C) have the same initial state metrics and all the starting states in 
E l (C) have the same initial state metrics, the best composite path at each boundary location 
ofT is the optimum path. If the best composite path is a tail biting path, it is the most likely 
codeword in C with respect to the received sequence r. 

Note that at the beginning of the first iteration of the IBD-V algorithm, all the starting 
states in both E 0 (C) and Z L {C) are set with the same initial state metrics. It follows from 
Corollary 4.1 that at the first iteration, the best composite path is found as soon as the two 
decoders meet at the center of the trellis T and this best composite path is the optimal path 
in T. If this optimum path is a tail biting path, then it is the most likely codeword in C and 

the decoding is optimal. 
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The next theorem simply says that if the condition of Theorem 4.1 does not hold, the 
best composite path found at any section boundary is not necessarily the optimum path in T 
for a given received sequence r. The proof of this theorem is similar to the proof of Theorem 
3.2. 

Theorem 4.2 If at the beginning of a decoding iteration, not all the starting states in Eo(C) 
or in El(C) have the same initial state metrics , the best composite path found at any bound- 
ary location ofT is not necessarily the optimum path p opt in T for a given received sequence 
r, and hence it is not necessarily the most likely codeword in C even if it is a tail biting path. 


Theorem 4.2 implies that for i > 1, if decoding decision is made during the i-th iteration, 
the decoded codeword is not necessarily the most likely codeword in C. Therefore, IBD-V 
algorithm is not an optimal MLD algorithm. However, simulation results of this algorithm for 
decoding many codes show that this algorithm achieves virtually optimum error performance 
with a maximum of only two iterations. 

After the first decoding iteration, in general, the starting states at either end of the trellis 
T do not have the same initial state metrics. As a result, the sets of composite paths at 
different boundary locations may be different. This fact can be proved readily and is given 
in the following theorem. 

Theorem 4.3 At the i-th decoding iteration with i > 1, the sets of composite paths at 
different boundary locations may be different. 

This theorem implies that after the first iteration, the best CP's at different boundary 
locations of the trellis T may be different and the best CTP’s at different boundary locations 
of T may be different. Therefore, to achieve good error performance, we must keep updating 
P(, ejt and pj e3t from section to section, because they are candidates for the decoded codeword 
when the decoding process is terminated at the end of / m ar-th iteration. 
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Since the trellis is processed by two decoders from both directions and the two decoders 
start to make decoding decision as soon as they meet at the center of the trellis, the IBD-V 
algorithm has a shorter decoding delay than an unidirectional iterative algorithm, such as 
the WAV algorithm. Furthermore, IBD-V algorithm updates its candidates for the decoded 
codeword continuously section by section rather than waiting until the end of an iteration. 
As a result, is chosen from a larger subset of tail biting paths of T than the WA-V 
algorithm and hence has better chance to be the most likely codeword in C. Therefore, the 
IBD-V algorithm achieves better error performance than the WA-V algorithm with the same 
number of iterations and converges faster to the MLD performance. 


4.3 Performance and complexity 

The IBD-V algorithm has been applied to decode several convolutional and linear block 
codes based on their tail biting trellises. Simulation results show that for all the codes 
being decoded, the IBD-V algorithm virtually achieves optimum error performance with a 
maximum of 2 iterations. Results for some of these codes are given in the following to show 
the effectiveness of the IBD-V algorithm. 

Figures 14 and 15 show the bit and frame error performance of the IBD-V algorithm for 
the (64,32) tail biting code obtained by truncating the rate-1/2 (2,1,7) convolutional code 
generated by polynomials (712,476). We see that the IBD-V algorithm virtually achieves 
optimum error performance with a maximum of 2 iterations (I m ax — 2). In the same fig 
ures, we see that the WA-V algorithm virtually achieves optimum error performance with a 
maximum of 4 iterations (7 mar =4). Table 2 gives the percentages of transmitted codewords 
that are decoded into the most likely codewords with IBD-V and WA-V algorithms for var- 
ious SNR’s. We see that even with SNR=1 dB, the IBD-V algorithm decodes 93% of the 
transmitted codewords into most likely codewords with 7 moi = 1 and 99% with 7 mar = 2. 
The WA-V algorithm achieves almost the same percentages with 7 maI = 2 and 7 mar = 4, 
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respectively. Table 3 gives the average numbers of Viterbi updates required for the two 
decoding algorithms with various SNR’s. We see that both algorithms requires relatively 
small number of Viterbi updates to complete the decoding even for small SNR's. 

Figure 9 shows the bit error performance of the IBD-V algorithm for the (128,64) tail 
biting codes obtained by truncating the rate-1/2 (2,1,6) convolutional code generated by 
polynomials (554, 744). Again, the IBD-V algorithm virtually achieves optimum error per- 
formance with a maximum of 2 iterations. In fact, for this long code, WA-V is just as effective 
as the IBD-V algorithm and it achieves optimum error performance with I maI = 2. Table 
4 gives the average numbers of Viterbi updates required for both algorithms with various 
SNR’s. 

Figures 10 and 11 gives the bit and frame error performance of the IBD-V' algorithm 
for the (24,12) Golay code based on the minimal 16-state tail biting trellis constructed in 
[6]. Again, we see that the IBD-V algorithm achieves optimum error performance with a 
maximum of 2 iterations. Table 5 gives the average number of Viterbi updates for both IBD- 
V and WA-V algorithms. We see that the number of Viterbi updates required for decoding 
this code is small even for low SNR’s. 

Finally, Table 6 gives the computational complexities for decoding the above codes with 
the VTMLD, WA-V and IBD-V algorithms, respectively. Also included in this table is a 
recursive MLD (RMLD) algorithm for decoding codes based on their tail biting trellises. 
This RMLD is. simply a generalization of the RMLD devised in [19] for decoding linear block 
codes based on their conventional trellises. We see that both WA-V and IBD-V algorithms 
significantly reduce the computational complexity for these codes. The RMLD algorithm 
also reduces the computational complexity compared with the VTMLD algorithm. 
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5 General Structure and Construction of Tail Biting 


Trellises for Linear Block Codes 

5.1 General structure 

The general structure of an L-section tail biting trellis T for an ( n,k ) linear block code 
C is depicted in Figure 5. Let {0,1,..., L) denote the set of section boundary locations. 
Suppose T consists of 2 m starting states and 2 m ending states. We may view T as a union 
of 2 m isomorphic (or structurally identical) subtrellises which share a common part from 
boundary location-ii to boundary location-^, where t\ < £ 2 • Each subtrellis consists of 
those paths in T that connect a state at boundary location-0 to the same state at boundary 
location -L, and it has three parts, the header, the center span and the tail. The center span 
is shared by every subtrellis. A subtrellis starts from a specific starting state at boundary 
location-0 and grows until it reaches to the boundary location-fi, it then transverses through 
the center span until it reaches the boundary locational and finally it starts to collapse until 
it terminates at a state at boundary location-T that is identical to the starting state. For 
0 < i < 2 m , let Ti denote the subtrellis whose starting and ending states are So,« and s L,i, 
respectively. Assume that T 0 contains the all-zero path. Then the paths in To form an 
(n, k - m) linear subcode of C, denoted C 0 , and the paths in any other subtrellis form a 
coset of Co in C. Let v = (t>i, v 2 , • • • , v„) be a codeword in C. Since all the subtrellises have 
the same common span from boundary location-tj to boundary location-f 2 , there must be 
a codeword w = (u.'i, u; 2 , w n ) in each subtrellis whose components from location-(ti 4- 1) 
to location-f 2 are zeros, i.e., U7 t ,+i = u; Jl+2 = = 0. For convenience, we call the 

part of first t\ components of w the header, the part of last n — f 2 components of w the tail. 
Adding w to each path in T 0 results in a subtrellis which is isomorphic to To and is identical 
to To from boundary location-<i to boundary location-t 2 . The header and the tail of this 
subtrellis are obtained by adding the header and the tail of w to the header and the tail of 
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To, respectively. This subtrellis is the trellis for the coset w + Co of Co and w is the coset 
representative. 

Although all the subtrellises share a common span from boundary location-^ to boundary 
location-<2- Two individual subtrellises may share a longer span starting from boundary 
location-i to boundary location-,; with 0 < i < <1 and £2 < j < L. For 0 < i < j < L, let 
[*,j] denote the interval {i, i + 1, • • * » j}- The zero-span of an n-tuple v = (ui, v 2 , • • ■ , u n ) 
is defined as the largest interval [i,j] such that v.+i = v,+ 2 = • ■ • = Vj = 0. This definition 
implies that v, = v J+1 = 1. Let v be a codeword in C but not in Co whose zero- span is [i, j] 
with 0 < i < ti and t 2 < j < L. It is clear that [<1, t 2 ] Q (i, j]. Let T 0 (v) denote the subtrellis 
for the coset v + Co obtained by adding v to every path in T 0 . Then T 0 (v) and T 0 have a 
common span from boundary location-i to boundary location-,;. Let v and w be codewords 
in two different cosets of the partition C/Cq. Let and be the zero-spans of v 

and w, respectively. Let [13,^3] = [ii,j\] H [12^2]- Then the co-subtrellises, T 0 (v) and T 0 (w), 
are isomorphic and have a common span from boundary location-1'3 to boundary location-j'3. 

5.2 Construction 

Based on structure analysis given above, a simple method for constructing tail biting trellises 
for linear block code can be devised. For 0 < t\ < t 2 < L, let C(ti,t 2 ) denote the set of 
codewords in C which satisfy the following conditions: (1) each nonzero codeword v in 
C(ti,t 2 ) has zero components from location-(fi + 1) to location-^* i- e -» u t,+i = u n+2 = • • ■ = 
v t2 = 0, and (2) the part of first t\ components of v contains at least one nonzero component 
and the part of last n — t 2 components of v contains at least one nonzero component. Then 
C(t\, t 2 ) is a linear subcode of C. The zero-span of each codeword in C(t 1, t 2 ) contains [< x , t 2 ] 
as asubinterval. Let m be the dimension of C(ti,t 2 ). There exists an (n, k—m ) linear subcode 
Co in C such that C is the direct sum of Co and C(U,t 2 ). Let C/Co denote the partition of 
C modulo Co- Then the vectors in C(ti,t 2 ) can be used as the coset representatives of the 
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coset in C/Cq. C(*i,* 2 ) is called the coset space of C/Co. 

Let To be the minimal conventional (one starting state and one ending state) bit-level 
trellis for Co [2]. Form all the co-trellises T 0 (v) of T 0 with v 6 C(t 1 ,t 2 )- AH these co- 
trellises have a common span from boundary location-*! to boundary location-* 2 . Putting 
all these co-trellises together and sharing maximum common spans between them, we obtain 
a tail biting trellis with 2 m starting states and 2 m ending states. The overall (state and 
branch) complexity of this tail biting trellis depends on the length of common span of the 
co-trellises, the choice of the boundary locations, *1 and t 2 , of the common span. These 
parameters should be chosen to minimize the trellis complexity. If the minimum distance of 
C is d, then the condition n — * 2 + *i > d must be hold. 

To facilitate the construction of a tail biting trellis for a linear (n, k) block code C, we put 
its generator matrix G in tail biting trellis oriented form (TBTOF), called the TBTO 
generator (TBTOG) matrix. The span of an n-tuple is defined as the smallest interval [a, b } 
which contains all the nonzero components. The active span of v is defined as the interval 
[a, b— 1]. For a vector v with zero-span [i,j], define its circular span as [j + 1, i]. In this case, 
the leading ‘1’ is at location-^ + 1) and trailing ‘1’ is at location-i. The TBTOG matrix of 
C is of the following form: 


Gtb = 


Go 

G c 


( 12 ) 


where (1) Go is the generator matrix for the subcode Co, (2) G c is the generator matrix for 
the coset space C/C 0 , (3) no two rows of G have their leading “ones” in the same columns, 
(4) no two rows have their trailing “ones” in the same column, and (5) the leading T’ of 
each row in Go appears in a column before the leading ‘1’ of any row below it. This TBTOG 
matrix can be obtain by performing elementary operations of the rows of a given generator 
matrix of the code. Go is in the conventional trellis oriented form and generates the minimal 
conventional trellis T 0 for the subcode G 0 [2, 3, 20]. From the TBTOG matrix Gtb, we can 
determine the state space dimension profile easily. At the state boundary location-i, the 
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dimension p, of state space E, is simply equal to the number of rows in Gtb which are active 
at boundary location-*'. Since the zero-spans of the rows in G c contain the interval [ti,t 2 ] as 
a subinterval and their circular spans are contained in the circular interval [t 2 + Mi]. these 
rows are not active from boundary location-ti to boundary location-*?. 

As an example, consider the (8,4,4) RM code generated by 

11111111 
0 0 0 0 1 1 1 1 


0 0 1 1 0 0 1 1 
0 10 10 10 1 


By elementary row operations, we obtain the following TBTOG matrix. 


Gtb = 


gl 


1 

1 

1 

1 

0 

0 0 

0 

g2 


0 

1 

0 

1 

1 

0 

1 

0 

g3 


0 

0 

0 

0 

1 

1 

1 

1 

g4 


1 

1 

0 

0 

0 

0 

1 

1 


(13) 


The first three rows of Gtb span the subcode C 0 and the fourth row g 4 spans the coset space 
C/Co which has dimension one. The length of the zero-span of g 4 is 4 and its circular span is 
[7,2]. Based on this TBTOG matrix, an 8-section tail biting trellis with two starting states 
and two ending states can be constructed as shown in Figure 3. Note that at boundary 
location-0 and boundary location-!, only the last row of Gtb is active. The state space 
dimension profile of the tail biting trellis is (1,2, 2, 2, 1,2, 2, 2,1) and its state space complexity 
profile is (2, 4, 4, 4, 2, 4, 4, 4, 2). To construct an 8-section bit-level tail biting trellis for this code, 
we first construct the minimal conventional 8-section bit-level trellis T 0 for Co . Adding the 
fourth row g 4 to the paths in T 0 , we obtain the co-subtrellis T 0 (g 4 ) for the only coset of C 0 . 
The two co-trellises share a common span from boundary location-2 to boundary location-6. 
Putting these two co-subtrellises together and sharing the common span, we obtain the tail 
biting trellis as shown in Figure 3. This is a tail biting trellis for the (8,4,4) RM code and 
it has different structure from the one constructed in [6]. It has mirror symmetry, i.e., the 
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right-half of the trellis is the mirror image of the left-half of the trellis. If it is sectionalized 
at boundary locations in {0,2, 4, 6, 8}, a 4-section tail biting trellis is obtained as shown in 
Figure 4. 

In [6], Calderbank, Forney and Vardy constructed the following generator matrix for the 
(24,12) Golay code, 


Gtb = 



11 

01 

11 

01 

11 

00 

00 

00 

00 

00 

00 

00 


00 

11 

11 

10 

01 

11 

00 

00 

00 

00 

00 

00 


00 

00 

11 

01 

10 

11 

11 

00 

00 

00 

00 

00 


00 

00 

00 

11 

01 

11 

01 

11 

00 

00 

00 

00 

gl 


00 

00 

00 

00 

11 

01 

11 

01 

11 

00 

00 

00 

g2 


00 

00 

00 

00 

00 

11 

11 

10 

01 

11 

00 

00 

: 


00 

00 

00 

00 

00 

00 

11 

01 


10 

11 

11 

00 

gl2 


00 

00 

00 

00 

00 

00 

00 

11 

01 

11 

01 

11 


11 

00 

00 

00 

00 

00 

00 

00 


11 

01 

11 

01 


01 

11 

00 

00 

00 

00 

00 

00 


00 

11 

11 

10 


10 

11 

11 

00 

00 

00 

00 

00 


00 

00 

11 

01 


01 

11 

01 

11 

00 

00 

00 

00 


00 

00 

00 

11 


(14) 


This matrix is already in the TBTOF given by (12). The first 8 rows of Gtb form the 
submatrix G 0 which generates the subcode C 0 . G 0 is in the conventional trellis oriented 
form [2, 3, 2<J\. By inspecting the active spans of the rows of G 0 , we readily find that the 
state space dimension profile of the minimal 24-section bit-level trellis To for the subcode Co 
is 

( 0 , 1 , 1 , 2 , 2 , 3 , 3 , 4 , 4 , 4 , 4 , 4 , 4 , 4 , 4 , 4 , 4 , 3 , 3 , 2 , 2 , 1 , 1 , 0 ). 

The maximum state space dimension of this trellis is 4 and hence its maximum state space 
has 16 states. If this trellis is sectionalized at the boundary locations in 

{0,2, 4, 6, 8, 10, 12, 14, 16, 18,20,22,24}, (15) 
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we obtained a minimal 12-section trellis for the subcode Co whose state space dimension 
profile is (0,1, 2, 3,4, 4, 4, 4, 4, 3,2, 1,0). The last four rows of the TBTOG matrix Gjb form the 
submatrix G c which spans the coset space C/Co • The zero spans of these last four rows 
are [2,16], [4,18], [6,20] and [8,22], respectively, and they contain the interval [8,16] as the 
common zero span. Therefore, To and its fifteen co-trellises share a common center span 
from boundary location-8 to boundary location- 16. In fact, by inspecting the zero spans of 
these four rows, we can easily determine the common center span of any two co-trellises of 
T 0 . Putting T 0 and its co-trellises together and sharing maximum common spans between 
them, we obtain the 16-state 12-section regular (or uniform) tail biting trellis for the (24,12) 
Golay code constructed by Calderbank, Forney and Vardy [6] as shown in Figure 6. By 
determining the number of rows of the TBTOG matrix Gjb that are active at the boundary 
locations, 0, 2, 4, 6, 8, 10, 12, 14, 16, 18, 20, 22, 24, we readily find the state space dimension 
profile of the 12-section tail biting trellis for the (24,12) Golay code is (4, 4, 4, 4, 4, 4, 4, 4, 
4, 4, 4, 4). 

Construction of the bit level tail biting trellis for C based on Gtb cai * be accomplished 
easily based on the state defining information set at each boundary location, and the change 
of the state defining information set from one boundary location to the next boundary 
location as described in [2]. The information bits in the state defining set A* at the boundary 
location-z defines the state space S, at boundary location-z and the change of the state 
defining information set from A * at boundary locatio-z to the state defining information set 
A* +1 at boundary location-(z + 1) defines the state transitions. Labeling the states helps the 
construction. 

Let C'(ti,t 2 ) be a linear subcode of C(ti,t 2 ) with dimension m' < m. A tail biting trellis 
for C can be constructed based on this subcode C'{t u t 2 )- Then the resultant tail biting 
trellis has 2 m ' starting states and 2 m ' ending states. Based on linear subcodes of C{t u t 2 ), 
we can construct various tail biting trellises. 
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5.3 Tail biting trellises for RM codes 

RM codes have relatively simple conventional trellis structure (2, 3, 7, 22] and can be 
effectively decoded with trellis-based decoding algorithms, such as the Viterbi algorithm 
and the MAP algorithm [23, 24]. In the following, we show that these codes also have 
simple tail biting trellis structure and hence can be decoded effectively with the two new 
iterative decoding algorithms proposed in the last two sections. 

For any integers m and r with 0 < r < m, there exists a binary r-th order RM code, 
decoded RM(r,m), with the following parameters: 

Code length : n = 2 m ; 

Dimension : k(r,m) = 1 + 4 1- (7)» 

Minimum distance : d m i n — 2 m-r . 


For I < * < m, let v, be a 2 m -tuple over GF(2) of the following form: 

v, = ( 16) 

21-1 2»-l 2 ,_1 2 1-1 

which consists of 2 m ~‘ +1 alternate all-zero and all-one 2 ,_l -tuples. Let a = (ai,a 2 , • • ■ ,a n ) 
and b = (6i, 6 2 , • • • , b n ) be two binary n-tuples. Define the following logic (boolean) product 

of a and b, 

a • b = (ai • &i,a 2 • b 7 ,- ■ ■ ,a n • 6„), 

r 

where u .” denotes the logic product (or AND operation), i.e., a,- bi = 1 if and only if 
a- = bi = 1. For simplicity, we use ab for a • b. Let v 0 denotes the all-one 2 m -tuple, 
v 0 = (1, 1, • • ■ , 1). For 1 < ii < i 2 < "■ < U < m, the product vector v„v 13 • • • v„ is said to 
have degree /. The r-th order RM code, RM(r, m), of length 2 is generated (or spanned) 
by the following set of independent vectors: 

{vo, Vj, v 2 , • • • ,v m ,v 1 v 2 ,v l v 3 , • • • , v m _iV m ,up to products of degree r}. 
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m 


i 

m 


If the vectors in this set are arranged as rows of a matrix, we obtain a generator matrix for 
the r-th order RM code, denoted G r<m . It is possible to construct a tail biting trellis for the 
r-th order RM code with a center common span of length 2 m_1 from boundary location-2 m-2 
to boundary location-3 • 2 m_2 . The lengths of the header and tail of each subtrellis are both 
2 m-2 . The code vector = v 0 + v m + v m _i, has the following form: 


(1,1, ...,i,o,o,...,o,o, 1,1, •••,1). 

' v ' " V " ' ' 

2m— 2 2 m ~ * 2 m ~ 2 

If we replace v m by and form the following basis for the subcode C( 2 m ~ 2 , 3 • 2 m_2 ) of the 
r-th order RM code, RM(r, m): 

£?(2 m ~ 2 , 3 • 2 m-2 ) = {v^,v^vi,---,v^v m _ 2 ,..., up to products of degree 

r with vj, as a product component} 

= { v m v u • • • v «i : 1 < h < *2 • • • < *i < m - 2 

and 0 < / < r — 1}, (17) 


where for / = 0, v^v<, • • • v <( = v^. Then the subcode C(2 m_2 ,3 • 2 m 2 ) is spanned by 

*=(V) + ( m i 2 ) +"+(?-i 2 ) (18) 

linear independent codewords, called coset generators in B(2 m_2 ,3-2 m-2 ). Each generator in 
B( 2 m-2 ,3 • 2 m-2 ) has a sequence of 2 m_1 zeros from position-(2 m_2 + 1) to position-3 • 2 m ~ 2 , 
both the header and the tail of each codeword contain at least one nonzero component. In 
constructing a tail biting trellis for the RM(r, m) code with a common center span of length 
2 m-1 , we can use any subset of B( 2 m_2 ,3 • 2 m-2 ) to span the coset space for forming the 
subtrellises (or to from the submatrix G c in the TBTOG matrix Gtb )• 

For m = 3 and r = 1, the RM(1,3) code is the (8,4,4) RM code given above. B(2,6) 
contains only one codeword which is (1, 1,0, 0,0,0, 1, 1). The TBTOG matrix for this code 
is given in (13). 


A 
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Consider the 2nd-order RM code, RM(2,5), which is a (32,16,8) code. There are a total 


of 4 generators in B(8,24) with a zero-span of length 16. They are: 

11111111 0000000000000000 11111111 
01011010 0000000000000000 01011010 
00111100 0000000000000000 00111100 
11110000 0000000000000000 00001111 . 


(19) 


Suppose we want to construct a tail biting trellis with 8 starting states and 8 ending states. 
We simply choose three generators from G c . A choice to minimize the trellis complexity is 
desired. One choice gives the following TBTOG: 

11111111 000000000000000000000000 
01010101101010 100000000000000000 
00110011110011000000000000000000 
00010001111011101000100010001000 
000011 1 1 1 1 1 100000000000000000000 
00000101111110101010000010100000 
000000 111111110011 000000 1 1 000000 
000000001 1111111 0000000000000000 
0000000000000000 1111111 100000000 
00000000000000000101010110101010 
00000000000000000011001 111001100 
000000000000000000001 1 1 1 1 1 1 10000 
00000000000000000000000011 1 1 1 1 1 1 


Gjb — 


01011010000000000000000001011010 
00111100000000000000000000111100 
11110000000000000000000000001111 
The first 13 rows of Gtb is in TOF and generate a (32,13) subcode C 0 . The dimension of the 
state space at the center point (boundary location- 16) of the bit-level minimal conventional 


( 20 ) 
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trellis T 0 for Co is 3. The 7 nonzero linear combinations of the last 3 rows of Gtb generate 7 
co-subtrellises of To- The state space dimension profile of the tail biting trellis is: (3, 4, 5, 6, 6, 


7 , 7 , 7, 6, 7,7,7, 6,6, 5,4,3, 4, 5,6, 6, 7, 7, 7, 6, 7, 7, 7, 6, 6, 5, 4, 3). The total number of states and total 


number of branches of this tail biting trellis are 2,392 and 3,392, respectively. The state 


space dimension at the midpoint of this tail biting trellis is 3. The maximum state space 
dimension is 7. However, the minimal conventional bit-level trellis with one pair of starting 
and ending states for this code has a total of 4,798 states and a total of 6,396 branches. The 
state space dimension at the midpoint of this conventional trellis is 6 and the maximum state 
space dimension is 9. We see that the above tail biting trellis representation of the (32,16) 
RM code reduces both the state and branch complexities by about one half. The number of 
states at the midpoint of the tail biting trellis is the square root of the number of states at 
the midpoint of conventional minimal trellis for the code. If we sectionalized the bit-level tail 
biting trellis at locations in {0, 4, 8, 12, 16, 20, 24, 28, 32}, we obtain an uniform 8-section tail 
biting trellis with state space dimension profile, (3, 6, 6, 6, 3, 6, 6, 6, 3). However, the state space 
dimension profile of the corresponding conventional 8-section trellis is (0,4, 6, 8, 6, 8, 6, 4,0). The 
TBTOG matrix given above meets the minimum sum of spans condition, and therefore the 
tail biting trellis is minimal in terms of product of the state-space sizes [6]. 

For r = 2 and m = 6, the second-order RM code, RM(2,6), is a (64,22,16) code. The 
conventional minimal bit-level 64-section trellis for this code has a total of 324,862 states 
and a total of 375,036 branches. Its maximum state complexity is 2 14 and the number of 
states at midpoint (boundary location-32) is 2 10 . For this RM code, a bit-level 64-section tail 
biting trellis with 8 starting states, 8 ending states and a center common span of length 32 
can be constructed. This tail biting trellis has a total of 117,360 states and a total 136,6(2 
branches. Its maximum state complexity is 2 12 and the number of states at midpoint is 2 7 . 
A tail biting trellis with 16 starting states and 16 ending states for this code can also be 


constructed. 

For any positive integer i such that m — r — 1 < i < m — 2, there exists a tail biting 
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trellis for the RM(r, m) code with a center common span of length 2 m — 2 ,+1 from boundary 
location-2’ to boundary location-(2 m — 2’) [12]. 

6 Conclusion 

In this paper, two new efficient iterative algorithms for decoding linear codes, block or con- 
volutional, based on their tail biting trellises have been presented. One is an unidirectional 
algorithm and other is a bidirectional algorithm. Both algorithms achieve virtually optimum 
error performance with a maximum of 2 to 4 iterations with a significant reduction in de- 
coding computational complexity. For short tail biting convolutional codes, the bidirectional 
algorithm converges to optimum MLD error performance faster and gives better error per- 
formance than the unidirectional algorithm. For long tail biting convolutional codes, both 
algorithms perform equally well and achieves virtually optimum error performance with a 
maximum of 2 iterations. The bidirectional algorithm reduces decoding delay. Both algo- 
rithms outperform all the existing tail biting trellis-based algorithms in performance and 
decoding complexity. In the paper, a simple method for constructing tail biting trellises for 
linear block codes has also been presented. 
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Table 1: Decoding complexity of various decoding algorithms in terms of number of Viterbi 
trials for the (64,32) tail biting convolutional code generated by gi = (1, 1, 1,0,0, 1,0, 1) and 




Table 2: Percentage of transmitted codewords that are decoded into most likely codewords 
for the (68,34) convolutional tail biting code generated by polynomials (712,476) using the 
WA-V and the IBD-V algorithms (minimum 10,000 transmitted codewords). 



WAV 

IBD-V 

SNR 

I max — 1 

Imax — 2 

Imax — 4 

Imax — 1 

I max — 2 

l.OdB 

71.65% 

93.68% 

95.98% 

92.91% 

98.66% 

1.5dB 

79.49% 

97.65% 

99.34% 

95.11% H 

99.81% 

2.0dB 

84.44% 

98.61% 

99.54% 

96.85% 

99.72% 

2.5dB 

90.54% 

99.67% 

99.89% 

98.71% 

99.96% 

3.0dB 

94.13% 

99.90% 

99.95% 

99.41% 

99.99% 
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Table 3: Average number of Viterbi updates required for decoding the (68,34) convolu- 
tional tail biting code generated by polynomials (712,476) using the WA-V and the IBD-V 


algorithms. 


SNR 

WA-V 

IBD-V ] 

Imax — 2 

Imax — 4 

I max “ 1 

Imax ~ 2 

Imax — 2 
(per decoder) 

l.OdB 

53.02 

79.33 

53.02 

79.98 

39.99 

2.0dB 

49.61 

70.33 

49.61 

69.92 

34.96 

3.0dB 

45.90 

59.96 

45.90 

60.52 

30.26 

4.0dB 

41.84 

50.61 

41.84 

50.71 

25.35 

5.0dB 

39.17 

44.69 

39.17 

44.66 

22.33 


Table 4: Average number of Viterbi updates required for decoding the (128,64) convolu- 
tional tail biting code generated by polynomials (554,744) using the WA-V and the IBD-V 


algorithms. 


SNR 

WA-V 

IBD-V j 

/mar = 2 

Imax — 4 

Imax — 1 

Imax — 2 

Imax — 2 
(per decoder) 

l.OdB 

99.17 

145.16 

99.17 

137.09 

68.55 

2.0dB 

92.18 

125.92 ! 

92.18 

122.36 

61.18 

3.0dB 

83.46 

103.99 

83.46 

103.27 

51.64 

4.0dB 

77.69 

92.89 

77.69 

91.46 

45.73 

5.0dB 

73.17 

82.90 

73.17 

82.35 

41.17 


fable 5: Avefage number of Viterbi updates required for decoding the (24,12) Golay code 
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state tai 

1 biting trellis using t 

he WA-V and the IBD-V algorithms 


WA-V 

IBD-V n 

SNR 

Imax — 2 

Imax — 4 

Imax — 1 

Imax — 2 

T - 0 

J max — A 

(per decoder) 

l.OdB 

17.79 

26.04 

17.79 

26.42 

13.21 

2.0dB 

16.02 

21.26 

16.02 

21.60 

10.80 

3.0dB 

14.24 

16.88 

14.24 

17.12 

8.56 

4.0dB 

13.09 

14.25 

13.09 

14.35 

7.17 

5.0dB 

12.43 

12.87 

12.43 

12.90 

6.45 
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Table 6: Decoding complexity in terms of number of additions and comparisons with various 
decoding algorithms at SNR=1.0dB (10,000 blocks). 


Code 

VTMLD 

RMLD 

WAV 
(/max = 4) 

IBD-V 
(Anar = 2) 

Golay (24,12) 

9,615 

3,379 

1,383 

1,668 

(64,32) (m = 6) 

397,375 

250,043 

11 flM 

17,694 

(128,64) (ro = 6) 

794,687 

643,323 


32,493 

(68,34) (m = 7) 

1,679,999 



39,761 



Figure 1: An 8-section tail biting trellis for the rate- 1/2 (2,1,2) convolutional tail biting code 
generated by g x = (1,0, 1) and g 2 = (1, 1, 1). 
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Figure 2: A minimal 8-section conventional trellis for the (8,4,4) RM code. 
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Figure 6: Four sections of the minimal tail biting trellis for the (24,12,8) Golay code. 
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Figure 8: BER performance of various decoding algorithms for the rate-1/2 (64,32) tail 
biting convolutional code with memory order m = 7 and generated by (712,476) over BSC. 
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Figure 9: BER performance of the (128,64) tail biting convolutional code generated by 
(554,744) using the WA-V and the IBD-V algorithms. 
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Figure 10: BER performance of the (24,12) Golay code with the 16-state tail biting trellis 
using the WA-V and the IBD-V algorithms. 



Figure 11: FER performance of the (24,12) Golay code with the 16-state tail biting trellis 
using the WA-V and the IBD-V algorithms. 
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Figure 12: Decoding complexity of the (24,12) Golay code with the 16-state tail biting trellis 
using the WAV and the IBD-V algorithms. 



Figure 13: BER performance of the (24,12) Golay code with the 64-state tail biting trellis 
using the WA-V and the O-CVA algorithms. 






Figure 14: BER performance of the (68,34) tail biting convolutional code generated by 
polynomials (712,476) using the WA-V and the IBD-V algorithms. 



Figure 15: FER performance of the (68,34) tail biting convolutional code generated by 
polynomials (712,476) using the WA-V and the IBD-V algorithms. 




